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ABSTRACT 

Three different methods of d^ata collection in vhich 
subjects judged proximity between obj,ect pairs were examined. One 
method regu^re^ subjects to partition object's into homogeneous 
subs;ets; the second entailed^^rating ob;ject ^pairs on a 
similarity-dissimilarity continuum; and the third involved comparing 
-interobject proximities to a fixed standard: The three types of 
proximities were analyzed by the nonmetric multidimensional"^ scaling 
procedure r subseguent multidimensional representations were 
compared for accuracy to a.c^ite^rion or true multidimensi'onii 
configuration of the same objects. Significant differences in , , , 
a'ccuracy were found among the three methods, presumably * due I^Q * 
differences in the .extent to which subje'ots were a.ble -to- describe 
their perceptions under the various methods. (Author/RC) . ' - 
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Abstract^ 



This study eMraincd ^three different methdds bf data^ collection .in^whifih sub- 



jects judged proximity between' object Wirs. One method required subjects to ^ ' 

. • . < » \ 

partition objects into homogeneous subsets; the Si^cpnd entgiled raCing object 
. ■'^ > * « • . 

• ' • ' '. • * 

pairs on a similarity-dissimilaritjr continuum; and the third involved compar- » 

ing interobject proximities to a fixed standard. The three types of proximities 

were yuly zed by the nonmetric multidimensional scaling procedure, and subse- 

queht multidimensional representations were compare^ for accuracy to a criterion 

^ . ■ • ' \ ' ' 

or true multidimensional con-figuration of the same oT}jects. Significant differ- 



ence's in. accuracy, were found among the three methods, presumably due to differ- 



ences in the extent to which subjects ^re abl*e 
under the various methods. * , 



to describe? thfcir perceptions 
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* . ♦ .. . , 

* # • • ; 

A Closer LooK at the Accuracy of Alternative 
Multidimensional Scaling Data 
Collection Methods 

* Uonmetric multidimensional scaling procedures, are becoming increasingly popu 
lar in educational research as a means for graphically, repres^enting Jthe network 
of relationships imbedded within a set of -data (Subkoviak, 1975)* Given •a mear . 
sure of pr9ximity (similarity or dissimil^tity) between eftch /air of n objects 
or variables, t^iese procedures represent the pbjects ^as points in multldimjnsi'on- 
al space so that similar objects are clo5e together and dissimilar objects are ' 
far apart, or to be* specific, so^that the rank order" of input proximities 'is the 
same as the r^nk orden of the .corresponding iYiterpbiat distances (Kruskal, 1964a, 

.1964b; Shepard, 1962a, 1962b). . • ^ . . . 

) - ' ^ ' I ■ ■ ' . 

Whil^ the mathematical algorithms fog locating points in space have^een 

wi<^ely discussed and compared (Lingdes & Roskam, 1973;" Spaeth & ^Guthery, 1969; 

Spende, 1972; Young & Applebaum, 1968), relatively little empirical work has 

^en done to coQtr^^ alternative methc/ds of collecting interobject proximities, 

,parti(:ularly in regard tOv^fijjje -accuracy of resulting multidi'»Aenslonal represfeh- 

tations. ' . 

Coombs (1964) , Torgerson (l958) and Wish (1972) have compiled taxonomies • 
of commonly used procedures for collecting proximity data ^ and Taylor (I969)*'hias 
discussed the issueg involved in selecting among these a;Lter natives. Taylor arid 
Klnnear ,(1971) also published *an empirical co^arison of six methods^'for deter- 
mining proximities among seven automobiles,, as perceived by 14' college students. 
The students judged proximities in each of the following ways. 
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■ ■. 1.' Vyad6. All possible palra of object pairs {(O^,0.)-,(0j^i0p} were . 
presented, an4 subjects picked* the most similar pair in each case*.- 

.i. Tiiaxt l/ A\l possible triples (O^f0j,0j^). were presented, and subjects 
\ cKosc the cbjbct most similar to the firs|: object* O^v- 'Each object In turn 
filled the firat position, . ' • ' ' . " ' 

-'3* ' TAMld II/ All possible tripl«s (O.fp.fO'J were presented, and subjects 
- selected the most similar and least similar pairs of the three obj-ects. 

'. "4. Rank OKdcA. Subjects ordered the i^^) object pairs (O-^OJ from most 
" to least similar.' / • • • . 



5. ^Rating Sca£e. Subjects rated the similarity of each-pair (0,,0.); on 
*a Likert scale. v \' " ' * . . ' 

6. COildUxoml Rank. Subjects ordered the (n-1) .Iremaining objects in 



V 



' tcrps of 2ir.ilsrit7 tz z sivcr/cbjcct* H^dh object iu turn served as Vae ,stau- 
dard% • * . , . . 

. Rank ord^r correlations between these methods, across the n(nrrl)/2 obtained ■ 
proximities,, were quite high,' with a median value of .84 and a range of .76 to 

;92;- thus indicating that the order of prpximities and, by implication, the 

. . . . \ . • 

order of interpoiht distances, was reasonably stable across methods. ..Cluster 

' * . . ' - .. 

analysiqi of the 6x6 correlation matrix suggested two ^somewhat distinct^ classes V 

— • , ' • ' . ' 

of methods an3 corresponding multidimensional representations: (a) dyads, rank 
orfler^and rating scale and (b') triad I,, triad 11 and conditional rank. iHe former\ 
class waa(^subjectively rated by subjects as. less accurate, more difficult, and 
less enjoyable than the latter. . . ^ ' ^ - 

Rao afid Katz- (1971) ^^ttCofed proximities for 'seven different data collection 
methods'to .reflect .the distances between. 40 cities in Southeast Asia. Sotne of , 
the \ methods involved grouping neighboring cities, others required selecting 
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pities nearby a given city, find still others entallf^ ordering cities with re~ • 

spect'to their 'distance from a specified city. For' each of the s^v.en method?, 

40 ' • ' . • - 

^he ( distances between cities .In a two-dimensional ret)resectatlon were cor- 

related with the .corresponding gfo^graphlc distances, providing* measures of re- • 

production 'accuracy 'dlff<irent from the Intermethod ^'conslrtency coefficients conir 

guted In the Taylor-Klnnear^study The simulated "select and order methods gen- 

erally ai>peared to product/more accurate rfeproduc felons than grouping methods; 



s , , 

:urate rfeori 

Although differences among methods were not pBsted fpr s^nlflcanqe. 
• , • *^ , r ♦ 

ro.ceaurqc ^; d 



- ' Neldell (1972)* *compared three mebhoH^ (ba^lc/altSk' Procedures 3; 5 and 6 of / 
^ the Taylor-Klnnear study) for determining pro:felmlfcle6 among six drug bij^nds/ln 
each of two^ classes (tranquUlaers and antlobeslty p^l^s), as p^rpelved by^en- . 
eral practltlonets.. In-each of the' six'' (method by drug class) conditions, 
physicians were contacted by on^ of three survey ^techniques- -single mailing, 

double mailing, or telephone. ^Th.e dependent measure^ 'Were response r^i^e ^pd pro- 

" ' ^ ■ - ' A ' ' • ' ' . 

portlortvof "fuljy completed returns, the latter varl3ble\^being one de term li\ant 

of represei^atlonal accuracy.* Slghlflc^nt differences at-Che ..05 level in the 

proportion of fully completed resjjonses were found between collection methods, '» 

but not between drug^claSsfes pr surf/ey techniques. Procedure 3 yielded -fewer 

completed' returns than the dther two. , ' ^ / ' • ^ * 

. • • ^ ' , • . %X ' ^ 

More r^pently, Henry and. Stumpf (1^75) compared thYee methods O?rocediires 
3, 4 and 6 of the Taylor-Kltinear study) fo.r deterpiLning .the distances ybetWteen 
7, .9, ill" 16 and 15 11/ S. cities as perceived by 15 college students^ih each of 
the 15 (method by stimulus set) "conditions.. One of the dependent variables 
considered was accuracy, as measured by the rank order correlation between 
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Intcrpolnt dis^auqcis in q two-(Jlmcnsional representation and the corresponding 

• ' " • I . . 

*X ^gcoBraphlc distances (see thp Rao and Katz study above) ^. A two-^ay, analysis 
variance indicated 'no significant differences in accuracy ticross either methods 
\ or. stimulus sets, and the interaction of the 'two factors was also nonsignificant- 

all tests being, performed at the .OS level. * * , 

/ Independent of the HenryrStumpf study, the present research emplojred 

.similar procedures to compare the accuracy of three data collection methods 

• \ ' . . ' ' ■ 

^crosff, two object sets. However, the methods considered, the measure of^ 

, ' accuracy employed, . and* the f inal^resiilts were quite different from those^of 

, Henry and Stumpf. . * " " . ^ y 

. " ' ■ ' . / ! IhzthodoloQij ' 

' . ^ I ' ' ■ * . * " . ^ ' T ■ 

* A "total of' 6C10 undergraduate sdd graduate stud^ents at ^the University pf . 

Wisconsin participated" in-the study. ^ ' ' . ' , ^ 

The subjects were asked to judge the intercity dis^ances^ between ,-10 U.S. 
*cltres.' Tw6 sets of'\b cit2:es were cqnsidered: (a)' Set 1 H {Philadelphia,^ 
Baltimore, D.etrolt, Atlanta/ Cliicago, New 'OrlTeans , Denver, ^Phoenix, Seattle^ 
.Los Angers} and (b) Set' 2 o {Detroit, Cincinnati, Atlanta, Miijneapolis^ S;t. 
touJLs-, Kansas City, N<iw Orleans, Denver, Phoenix, Hqiis ton} The 10(10-1) /a- = 

* . 45 iiitQrcity difitancesL-Of Set, 1 are hoterogxsneotis .(standard deviation 660 ^ 
: ' > ' ' ^ \ 

^ miles) while those *of Set 7 hre^ homogeneous (standard deviation 36^ miles) . / 
^ . " ... 

; /TJius, intercity distances of Set 1 arc generally easier -to differentiate than 
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Subjects judged, the Intytcity distances -.1^. 6ne'' of J three ways — syDrtlng, 
rating, or ' comparing . 'A^ -expli^lned' below, fchpse methods -differ e^s^ytlally In 
the^number- of res^nse^a^egq;:lfeg or >6cale points th^t^ ^ubjects vare permitted 



to usa In judging the Intercity distances.^ As'-such, the methods v5ry In th'e 
completeness with which subjects ^can report perceived dlffjerencjes^mong the 45 
Intercity distances. ^ j * ♦ * * 

. \\ " SonXijlng. As In the Rao and iCatz study -(1971) subjects ported the 10 
•.jiities. l^tp mutually e^xclusiy^ and» exhaust Iv^ groups ^o.'thaX: pities* In the sarie ^ 



gr^up were^ nearer to -each other-^han to citifes ly^othgr group*. TWe proportdon 




^ This type of^ inMc ha-s been; employed lhvfnultld*lmens'4onal' analysis ol? per-< 
sbnallify'^tralts '^Rosenberg, Nelsyn & VivekatiantK^ri, d968) ,^ nations .(Wi^h, Deutsch • 



Biner, :^970) arfd unl^elfslty faciilty (Subkdvlak & Leprirtr>974)S 
required Is Wte sliiiple, and ^thug* the mef hod^is ,partlCti^ariy appropriate 
•use with unsophis'tlca^ted siift^ects arid/or domplex object properties..^ AriothQt 
< advantage ''of 'the procedure is that subjects can- respond to a"Xarge ^numb^ ' 
of objects 'in a relativ.ely •shqrt -span of time. A distinct disadvantage of, this 



approach Is that^^a sltjgle sofrtln^xprovldes no Ififormatlon abou£ proximity dlf- ; 

ferences betwee"n pbjects within the^s;amfe .group or about proximity differences 

between gr.OAips.. These ^ortcbmings can be remedied, but'at'^th^ expense t)f time . 

• * * ^ ' \' ' )|> * ** 

and .simplicity* For example, .a£tcri.the initial 'gtouplng., subjects could be ' 

. v' ' \ ' * 1 * ' * • ✓ • ^ ^ \ 

asked to j'udge'*'proximijt^e^/between dlf fere^t* group's or between dbj^ecte withln\ . 



the , same group . ^ ' ^ • ' > ' * 
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» . • • • * 

2. Rttttng. As in the Taylor-Kinncar (1971) and Neldell (1972) st^udies, 

"Subjects judged the 4istaneq,s. between all^AS pairs of 'citi^s^cn a 

■Lik^irt scale, i.^, SIMILAR : 0 1 2 3 4 5 6^J^9 DISSIMILAR. The average / 

rating .for pair (0. ,0.) was computed ^s* the proximity index. 

This, type of measure has been employed ip multidiinenslonal . analyses of ^ 
* , • • • 

geometric figures (Attneave, 1950), attitudes (Messick, 1954) and interperson- 
al relations (Wish, Kalplan & Deutsch, 1973). A number of variations in the 

t - . i . 

,mode of object preseritation and tfte type o^ rating scale are possible (Torger- 

' * ■ \ * ■ 

son, 1958; , Wish', 19^72); -but the* jud^meutal task remains basically bne of " judg- 

ing the absolute proximity of each'^object .pair , as opposed to judging the pfox- 
imity of ^ne pair relative ^to that of 'another pair (see the Comparison .me tjiod 
discussed below). Complete information is obviously obtained about all nCn-l)/2 
iuterobject proximities, at^.the expense of time and subject fatigue as q be- 
comes large. , ' ^ • .i^ ' < 

3. Comria/Um"* Subjects reported the distance'. between each pair of- cities, 

(O^ .0 ) as a Df^rcentage of the distance bet^pen New York City /and San Franciscd, 
i j . * > ^ ... * " V * ' 

^wh^h is essentially. a J ob-poxn;t^ ^cale . The average percentage for pair jo^,Oj) 

was taken as the proximity. , • ^ ^ - 

' , » • • ' • 

Thisc apij^oach has bee* used with much success in judging the geographic ♦ 

proximity of various world cities -(Ltindberg & Ekman," 19V3) , and the method ^ 

generalizec. asily to .othei; types of stimuli. Like»ratihg, the comparison 

/ , • * 7^ • * . # , ' * * , ' 

method produces complete * info rmatij.ort aHqut interbbject proximities £or a greater 
>v , ■ . ^ ; ^ . %. - . • ^ 

investment of xtime. In* addition, this procedure may tend to produce mor^ vaiid 
f ^ :^ V . I 

^nd consistent ?lata. than rating if subjects perceive the standard (distafice 

• • • ' 

between New York City* and San Francisco) as more stable and well-defined than, a 

» 

Libert scale. , . . ^ , 
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. 'P/iocecfa/ie * . * " . . * 

*• • ' ' * • 

. ' ' ' • V ' 

.The three data collection methods were completely crossed Kith the two stim«- 

• ulus sets for ,a total of six conditions/ and a different form^ questionnaire 
was prepared Jor each, condition. The six f orms^ of t}ie questionnaire were ar- ^ ' 
ranged in cyclical order and ydfstributed to en^act classes .of coninuui cart ion arts 
and- educational, psychology students, randomizing th# assignmerit of 100 subjects 

/tojpach condition (Underwood, 1966, p. 115). In so doing, subjects were told 

. that their questionnaires were not necessarily the same as those of their 
neighbors, .but theyWere -given no ^dditior^l or specific information as to* the • 
nature of thd experiment. Subjects then performed the sortihg,^ rating or com- 

' paring task at their own rate and theri broke a seal on the last page of the * . 
q^uestionnaiVe and made a copy, of their 'own cognitive jpap by locating tl\ea(>' 
cities, in the stimulus'sfet op 'a completely blank outlioie representation pf the 
'continental United States on which nd man-made or natural featuifes were depicted. » 
The subjects were instructed to complete the map without referring to their pre- 
vious sorting, rating x^r compearing responses, so as to maintain some degree of 

"independence between the two tasks. As subjects cgmpLeted their maps", th)by re* 

• . , ■ . ♦ • * • '• 

turned ,thfeir iilater.ials to the experimenter who recorded ^thd, total time reqiiired 

to complete the questionnaire plus map. - 

^/ The intercity distances on cognitive map were ^sed to determine the • ^ 

•acc'uracy of sorting,- rat>ing ^pd comparing judgments as previous studies have 

employed- actual giBographic map^ (Henry Stumpf, 1575; Rao & Katz, 1971). ^ ^ 

Since a^'number of .'studies 'h^ve demonstrated that a person's cognitive map. may ' 

' * deviate, significantly from Its geographic counterpart, (Shepard, 1957,^ 1972), it ^/ 



Eelt that ^ the cognft\ve map from which spiting, rating and comparingT^judg- 

> to as£ 



ments were- derived was a" better standard, by which, to assess the accuracy of those / 



.was - „. . ^ ^ 



judgments than a possibly aberrant geographic map. 
' ' / ' \ ■ ^. ' • • . . - - ■ / 
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fhe group of 100 subjects In eacj^ condition was randomly partitioned into 

10 subgroups of lO^subjects; and a separate multidimensional representation was 

recovered fo|| each sufegroup as follows, . ^ ^ i 

A Jiumerical Judgment S.. of the proximity between the 45 possible pairs of 
• * • • / ' 

cities wiis obtained for each subjecit, small , numbers indicating that a pair. was 

V - . • ^ ' . y 

geograpI\lcallNy close ^and large numb'ers meaning the opposite. In^ the sorting 
. task a pair was coded 0 if a subject placed those two cities in the'same clus- ^ 
ter orl if they were* placed^ in^'dif fercnt clusters; in the'rating task pairs 
were scored 0 through 9; and in the comparlfng task^ pairs were gpndrally scored 
p through too pcifccnt^ (t *few pairs, were judged greater than 100 percent ot the 
-standard by a small .numbct of .subjects) . Scores S^^^ for pair (0^,0^) were <o 
'then averaged acjross the 10 sQbjects in each sobgrout) to obtain a subgroup 
proxinvit:^''nieasure^^\'= ZS^^/lO for thcj)air?. , • ■ ^ . - . 

* The proximity measures were next^input into a nonmetric multidimcn- 
.sionai scaling program^MINISSA-I (Lingoes, 1973) » and a two-d^mensl^l rcpr^^ 
sentation ot the lo cities (defined by numerical coordinates) was obtained for 
each subgroup. The 45 Euclidean distance.? *^^^il ^ ^jl^^'"^ ^^12 ^j2^^ 

were computed between all pairs of cities 'in the^ representation,, where ^^"^ 

^ * • . * * . . . 

(x^j, ,x^P are the two-dimensional coordinates locating city 0^ in the config- •* 

*^ ' * * 

uratioja for the. 10 ^bjex:ts. The j)urpose of the study was to compare . these 
- A- • • 

MINISSA-^r distances for accurat^ to the 45 corresponding distances between 
cities on' the cognitive maps of "the" same 10 subjects. ' < 

^ ■"Accordingly, the coordinates (X^^j^.X^^^ locating each city o/on each of the 
|dO cognitive maps were obtained using <in eleccionlc digitizer that determines 
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<*oordinates in units' .of 1/200*^ of" an inch.^ Euclidean distajhces 

* * • - • • 

D n'V(X - X + ^^i2~" ^ji^* were , obtained for each, suWect and averaged 
to provide a subgroup measure D^j « of the cognitive distance between. 

^ ^For purposes of comparisotv, the MINISSA'-I distances d^^ were transformed to 
. the same units of measure (i/^O^^^- df an indh) as cognitive distances D^.v' 
:^ Tlie new MINISSA-I distances were given by d' • = ; d where a = ^^^ij^ij/^^Lj. 

is chosen to minimize Z(D,, - d'Y^, This is an admissible^ linear tr^iJs^nna- 

iJ • iJ 

tioaof ratio scale distances (Lord & Novick. 1968, p. 21) and corresponds to 
- . ■ * . . * ■ '^'> , • . ■' '■ 

■ a. uniform shrinkihg. of the MiMsSA-I configuration to make it comparhble to.. 

the cognitive map. ' . ■ . '. ^ 

Finally, the typical percentage of discrepancy betweetT cognitive D^j and- ' 
MINISSA-I d|.j across all 45 distances computqd as the- measure of corre-" - 
spondence between^ the cognit*ive rtaps '/nd the sortlng, rating or comparing J udg- 
mcnts of the 10 ;,uDjcctsv (KruiMcal, 196Aa, p. 15). " <t . 
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Percent Error 




•For example, as' shown in Table 1 for -sortings of Set 1 cities, interpoint dis- 
"t^riccs^d* ^ typically diffci^from cognitive distances ,D^, by' A9 percent, . . 



ij 



RUdtts and V'Ucu^^A.on 



<x Table 1 shows the mean percentage of discrepancy between cognJLtive distances .D 



I 

and MINISSA-I distances d^. and the standard deviabioa for each condition. The 
two-way; fixed-effects analysis of variance for thdse data is shown in Table 2. 



Insert Tables 1 and 2 about heje 
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As Indicated, thete-wad a significant difference In representational accur- 

acy. across data collection metHods and stigtulus^sbts; and the interaction was 

also Significant. Methodc accounted for (\768/1.310) x->100 = 57 percent of the 

accuracy va^iante; stimuii accounted for only (.055/1.310) x 100 - 4 perce^it; 

and ^interaction accounted for ( .165/1 .310) x 100 = 13 perce.at,' leav,ing 26 vper- 

cent bf the total Variance unaccounted for ;(Marascuilo, 1971, p. 365)* Thus, 

method of data collection was the most important determinant of representational 

— ^ // • ^ • ' . • 

accuracy, while stimulus set hdd little real effect. / 

• Schcffe post hoc comparisons of thjs three "method means at the .05 level 
.indicated that sorting was slgnif ic'antly less accurate than eitjier rating or 
comparing, while there was no significant difference bctw«ori the latter two 
methods' (Harascullo, 1971). A study by Gireon and^llftio (1970) . of fers a possible 
explanation for thete outcomes. Using ^.unu^^oXed data, they 'found that scales 
with only 2 or 3 response categories forejudging proximities resulted iri^-less 
rfccurate multidimensional representations than scales with 6 or 18 categories* 
The present study suggests that this finding extends 'to the KdixL WOKtd, Sort-, 
ipg* involved only 2 catego-'ies, whereas rati<n"g and comparing involved 10 and, 
100 or more ca^tegories, respectively. 

While the difference in accuracy, between Setfe 1 and 2 wqs significant, 
perhaps the %ore interesting -finding with respect to this factor was that these 

sets accounted for only A percent of the variance in , 
the dependent variable. Thusf^ the effect of stimuli .was relatively less 
important than the other sources of variance considered in the study. ^ 

Sc^ieffe post Jhoc analyses of simple interactions at the .05 level ' 
Indicated Chat the inG?aea6e in accuracy from Set 1 to Set 2 fojr sorting was 
signiHiii^nt compared ,tb that fpr rating or comparing. Moreover, there was no. 



quite .different stimullj 



^- * ' * • ' ' A Closer^Look 

• •• . ' . ' ^2 

ht * 

significant differencfe between rating and comparing in this regard • The a?- • 

pa^eAt .reason is as follows. For the more widely dispersed cities of Set 1, 

most subjects formed the same clusters. Therefore, a bimodal proximity distri- 

\ ^ • - 

bution of O's and I's occurred that did not correspond well to the uniiftddal 

distribution 'Of actual cognitive distances. On the other hand> greater vari- 
ability in def ining* clustets for th^ore tightly knit cities of Set 2 pro- 
duced a distribution of proximities that compared more favorably to that of the^ 
cognitive distances, thus t^ increase in accuracy from Set, 1 to Set 2 for the 
sorting method. However, in rating and comparing tasks, obtained proximities 
for both Sets 1 and 2 compared almost equally well to the distribution of » 
cognitive dlstnncoi^; thus there was litjtle cha;ige in accuracy across sets. 

The pr.imary conclusion to be drawn from the study Is that sorting tends to 
produce less ,accurate. multidimensional configurations ;han either rating or.com- 
paring for groups^ of 10 subjects. Interestingly, as shown in Table 3, the ac-' - 
curacy of Set 2 sorting, i.e., 6on.tLng6 Hiat voAtj acA066 ^afa/fcti; .appears to 
become more equivalent to that of the other two procedures as ihe number of sub- 
jects* increases. Since sorting requires less time thar^ rating pr comparing— 
about 7'- 1/2 as opposed to U and 11 1/2' rainuteS in ther present study, the former 
nlethod may be a reasonable alternative* if stimuli^ ^re ^'E'onduciye ^to variable 
clustering aud 20, or more* 'subjects are employed. ^ l^oreover, since" sorting .time* 
is a function of n,. whereas rating and comparing tim^s are a function^rof n(n-l)/2, 

^ f "99 * 

the saving in time and effort increases markedly as n increases. , , 
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t ' . Table 1 

. Mean and Standard Deviation/ of Percent Error 

*■ a . ■ 

Across Replications > 





'* ' ' . 


' Mcth^j 


■ -'• . 


Stimuli 


Sorting 


. Rating 


• Comparing. 

. — ^ 

V > 



Set 1 



S 



.49 
.15* 



.18 " 
.12 



" .11 



.03 





ft 

X 




:29> 


-* 




. a5^" 

» 


Set 2 * 


■S 


• 

t> 


.04 




\ ^ -.03 


; .02 . 












f i. 





jo subgroup£5 per condition. 
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Table 2 
Anal«^,sls of Variance 









SS 






* 

Method 




2 




.384 


64.00* 


Stimuli ' 




1 


.055 


.055 


9.17* . « 


Interaction 


- f 


2 


.165 


.083 


13.83*4 


* Error - 


c 


5A 


^ .322 / 


.006 • 




• 

• Total 


i 

- • 


59 


i.3io" 




** 



' * Significant at l05 level 



- A 



s 



1,9 



r 



A Closer Loo]^ 
18* 



. • •* . Table '3 ' • 

Mean Percent Error for Subgroups of Various Sizes 



a,b,c 



Stimuli 




Metljod - ^ 


\ 

* \ 


Sorting 


Rating 


. 1% 

1 Comparing . 


W = 10 W » 20 W = 100 


M = 10 W » 20 W » 100 


» 10 .V V 20^ N ' ioo 

h » 


Set 1. 


' .49 .46 > .32 


.18 .12 .0? . 


( 

.11 .09 ' .08 • 


Set \ 


.29 .21 . .l^ 


.17 .16 .17 


-c . ■■ - 

• .15 .14 .15 



■ 1 



10 subgroups of'W « 10 subjects. 

b 

. 5' subgroups * of W » 20 subjects * 
1 subgroup of W « 100 subjects. 
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. - * . ' . • • •' ■ ■ 

Footnotes ' " 

r. Copies of all instruments used in the study have been filed with the ERIC 

Clearinghouse* on Tests, Measurements and Evaluation under 'accession number ■ 

and thus are available from that source, * ** « * j 

*' ' ' . ' 

2:, The .authors gratefully acknowledge Ur* Wendel K. Beckwith, II of*, the Geo- 
s ^raphy Department at the University of vWisconsin for his assistance in tbls * 
^ phase of the study* ^* j ' 
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Mr. 



NAME- 'D;fe _/JV_ : COURSE NO, 

' This questionnaire asks about thfi# distances bdtween the"" following 
U.S. Cili^s,: , * ' 



Denver KansasH^i, t|p^ 

" Phoenix New Orlea3as\ 

St. Louis . Detroit » 
(Jincinnati Houston , 
Nfilnneapolis Atlant?a 



In Item 1 below rate the. distance .between Cincinhati. mid Denver 
on the scalfe 0,l,2,3,4.,5-,6.,7,8>-,9. *Sinall numbers 0-4 indicate small 
distances, and 'the smaller the number the smaller the distance" between 
the two- cities. Large numbers 5-9 indicate large distances, and tlie 
larger the nitinber, the larger t^^stance between, tb^ two cities. 

Please circle one and only^e number 0.,.lV2,3,4,5-,6,7,-8,9 in . 
each of the following items. ... • V \\ 

' ^ ■ ■■ * . t LARGE- 



i. Ciiicinnati. -, Denver ^ Q 1 2 •3.4- 5-^ 6 7 8 -^9 

2.. .Cincinnati - Houston 0 ' 1 . 2 3 ► 4 • 5.^ ^7 8 /9^ ' ^. 

3. ■ Atlanta - Denver 0 1 "2 3' .4 5 ' 6 ( .7 " 8 9 ■ 



4; Phoenix - Minneapolis 0 1 2 ' '3 ' 4 -S'- 6. ;7 ^ 8 9 

5. New Orleans - St. Louis 0 1 .2 3 4^ 5- >^.7 X-- ^ 

6. Kansas City '- Denver 0 1 2 • 3 . 4^ 's. 6 7* ^ 9 

7. New Orleans - Houston 0 1.2 3' 4 5< 6 7 8;' 9 

8. « Houston - ^sas City 0 1 2 3 '4 SV 6 7 8 *9 
^9.' Atlanta Detroit ■ 0 ■ 1 2 "3 4 5 • 6.., 7 8- . 9 

10. Cincinnati Detroit . 0 1 * „ 2 3 4 5 6 7 8.9* 

11. Dctrok - St. Louis 0 1 2 3 • 4 "5 6 .7^ 8." 9 

12. ' Kansas City - Detroit ^0 !» 2 3 4 5 6 - ^,.7» -8 9- 

13. Cincinnati - Kansas City ^0 ' i 2 3 4' 5 6 *7 8r 9 

0 1 2 3' 4 .5 6 •7> 8 . '9; 



14. ^K^sas^ity - New Orleans- 



r 



15. New Orleans - Atlanta , 0 1 2 3-4 5 6 7- 8" 9 

•I • 



PLEASE TUl^N TO TTIE NEXT PAGE. 



y. 



• ■ ■ • 

16 • ItoWton - Denver • 
* . * *" 

y 17. Atlanta - Cincinnati* 

18. Atlanta - Minneapolis 

♦ 19. Phoenijc - Kansas City. 

20. Miimeapolis - St.-Lcrtlts ■ 

21. Detroit -.PhoeAix 

22. Atlanta -'Phoenix . 

23. ^ Denver - New Orleans 

24. I^w Orleans - J^oeni'x 

25. Detroit - Denver 

, 26. Kansas City - St, Louis- 

27. Atlanta,- St. Louis 

28. Gincinnati - Minneapolis 

29. Cincinnati • St.- Louis 
' '30. Minneapolis - Detroit 

31. New Orleans - Cincinnati - 

32. .Atlanta ,- -Houstort 

33. Atlanta. - Kansas Gity 

34. Phoenix - Cincinnati 

35. St'i' Louis - Phoepix f "'"' 

.■ 36. Kansas City - Muineapoiis 

- 37. • Denver - Minneapolis ^ ' 

38. Minneapolis - Houston 

' 39. St. Louis - Houston 

40. Minneapolis, - New Orleans 

41. -^Dehvor .-.St:-Lt)uis ;. ■ 

42. Phoertix/''^nver''< : ^ ' " 
, 43. Phoenix .Houston" 

• 44". Houston - Detroit • 

<^..4S'. Defre»iV - Js'cw/ Orleans 




■ 0 
0 

•0, 
0 
0 
0 
0 
0 

■ 0- 
0 • 
0 • 
6 
0 
0 

0 
0 
0 
'0 
0 
0 
0 
0 

■0 
0\ 
0 
0 

0 ' 
' 0 



LAllCJ; 




TO TIE MffxT PAGE. 



ERIC 



2^3 



.1 



/ . 



( 



COMPLETE HE OHER Py\RTS OF TIE Ql]EStIONNAp: 



TlffiN TURiTTO TJE N!3>rr PAGE AND CO?ffINUI-. 



• s 



/ 



I 
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DIRECTIONS 



Do this paRC larft, .Be suje you have completed the other parts 
of the questionnaire before you. begin. 

Use your mental picture or image of the U.S. to locate the 
following^pitics on the map pro^Tided below. ^ ^ ^ 



1 . • • Denver 

2. Phoenix 

3. ^ St. Louis 

4. " Cincinnati 

5. Minneaiylis 



6. Kansas ^City 
New Orleans 
8^ Detroit 
9} jiouston 
qj/.^Atlanta 



Use a^t (0 to irfdicate the location of each city on the jiap 
below. Then write the number of each city (1 thru 10 above) over its 
'dot (b. H^ase be sjire to place all 10 cities on the map. ^ . , 



Mm. 1 I 



ODUl^SB NO. 



1 



DIRIiaiONS 



* This questionnaire asks about the distances between the . 
following U.S. cities. ' ^ . 'i 



Los Angeles 


Chicago 


Phoenix 


Denver 


Baltimore 


New Orleans 


Detroit 


Atlanta 


Seattle ' 


Philadelphia 





^Imagine that tlie distance between New York City and Sari Francisco 
equals 100 units. Now compare the distances between the cities above 
to the distance between New York City and Sari Francisco. For example,' 
the* distance between Detroit and Los Angelas is what percent of the. 
distance between New York City and San Francisco? Record your answdr" 
-in~ Item 1 .below.. 

Ccmiplete all the other items in the same way. * Compare the 
distance between the given cities^to the distance between New York 
Ci?y and San Francisco, and then record y^ ur answer gs ia-^)ercent.. 



i. 


Detroit - Los Angeles 


is- 


% of New York City. - 


San Francisco 


2. 


Atlanta - Detroit 


is 


. I of New York City - 


San Francisco. 


3. 


Philadelphia - Los Angeles 


is 


% of New York City - 


San Francisco 


4. 


'Phoenix - Seattle 


is 


% of New York City - 


San Francisco 


5. 


^Itimore^ - Denver ^ ' 


is 


% of New York Citv - 


San Francisco 


6. 


Chicago - Los Angeles ■ / 


is 


% of New York City - 


Sgn Fran9isco 


i: 


Denver - Atlanta 


is 


. % of New York City - 


San "Francisco 


8. 


Atlanta - Chicago 


is 


% of New York City - 


San Francisco 


9. 


Philadelphia - New Orleans 


is 


* % of New York City - 
% of New York City - 


San 'Francisco 


10. . 


Detroit - New 0rleans 


is _ 


San Francisco 


11. 


New Orleans - Baltimore ' 


'is ^ 


i of New York. City - 


San Franc2,isco 


i2> 


Chicago - New Orleans ^ 


is 


% of New York,'City - 


San irancisco 

< 


13. 


Detroit Chicago 


is 


% of New York Q^ty - 


San Ptahcisco 


14. . 


Chicago Denver * , 


is ^ 


% of New York City,/ 


San Francisco 


'15. 


Denver - Philadelphia v 


is 


% of New 'York City - 


San Fjranciscg 



PLEASl- TURN TO 'HIL' NEXT PACI-. 



,16. 

17. 

18.' 

19. 

20. 

21. • 

22. ' 
23, 
24. 
25. 
26. 
27.- 
28. 
29. 
30/ 
31. 
32. 
33. 
34. 
35. 
36. 
"37. 
'38: 
39. 
40. 
41.' 
42. 
43. 

.44., 
4.5. 



Atlanta Los Aiigclcs • 

Philadoiphia - Detroit • 

Philadelphia".- Seattle " 

■^oenix - Clucago" 

Seattle - Baltimore 

New Orleans -'■ Phoenix 

Philadelphia - Phoenix . 

los, Angeles' - Denver " 

Denver - Phoenix . 

New Orleans - Lbs Angeles 

Chicago^- Baltimore 

Philadelphia - Baltimore 

Detroit - Seattle 

Detroi-t - Baltijirare 

Seattle - New Orleans 

Detroit - Denver 

Atlanta - Philadelphia ^ 

Philadelphia - Chicago 

' Phoenix - Detroit 

Baltimore - Phoenix ^ 

Chicago - Seattle 

Los Angeles - Seattle 

Seattle - Atlanta" 

Eialtimare- Atlanta 

SeaJ:tle - Depver ^ 

Los An'geles"- Baltimore 

Lds Angeles - Phoenix 

■ Phoenix - Atlanta 
J" » ■ . 
Atlanta - New Orleans 

New Orleans - Denver ■ ' 



IS _ 

'is _ 

is _ 

is 

is 

is _ 

is _ 

is 

is 

is 

is 

is 

is 

is 
. ^ 

IS 

is 
is 
is 
is 
is 
is 
- is 
is 
is- 
is. 
is 
is 
is 
is 
is 



% of 



_% of 
J of 
% of 



^ of 



% of 



h of 
J of 
J of 

% of 



of 



% of 



> of 
% of 



% of 
% of 



% of 



% of 



} of 
I of 



_% of 
% of 



% of 



% of 



% of 



y of 

Voi 
% of 



New Vark City.^- San I'rancisco 
New York City ,- San I'rancisco . 
New York City - San "Francisco 
New York City - Saii Francisco 
New York City - San Francisco 
New York City - San Francisco 
New York City San Francisco 
New York City - San • Francisco 
New York City - San Francisco 
New York City - San Prancisco 
New 'York City - San Francisco 
New York City - San Francisco 
New York City - San Francisco 
New York City - San Francisco 
New York City - San Francisco 
New York City - San Francisco 
New Y^yrk City - San Francisco 
New York City - San Francisco 
New York- City - 'San Francisco 
New York City San Francisco 
New York City - San Francisco 
New York City,- San Francisco 
New York City - Sari Francisco 
New York City r San Francisco 
New York City - San Francisco 
New York City - San Fran.cisco 
New York City - San Francisco 
New York City - 'San Francisco 
New York City - San Francisco 
New York City - San l-rancisco 



PLEASH TUIW TO 'HIK NEXT PAGO. 



i 



I 



♦ 



COMPLET^x^E OTHER PARTS OF THE QUESTIOimiRE 



THEN TURN TO TTE NEXT PAGE AND CONTINUE. 
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DIRECTIONS 



Do this pn^c last . Be* sure you have cowpleted the other parts 
of the questionnaire before you begin. 

bse- your mental picture or image of the U.S.'to locate the 
following cities oh^tlie map provided below. 



1. 


Los Angeles 


6. 


Chicago 


2. 


Phcrcnix 


' 7. 


Denver 


3. 


Baltimore 


8. 


New Orleans 


. 4. 


Detroit * 


9. 


Atlanta 


5. 


Seattle 


10." 


, Philadelphia 



Use' a dot (•) to indicate the location of each city on the map 
below. Then wite the number of each city (1 thru 10 above;) over its 
dot (b. Please b'e sure to place all 10 cities on the map. 



PLEASE lU-lURN '1111: BOOKLET TO 11 IE PROCTER IVHEN^fOU IIAVE I'lNISiniD. 
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NAMl: 



DATl- / • / CimSl: NO. 



* • Dim-rrioNS 

Tins-' quc&ti9iinaiT0 asks about the distances between the following 
U.S. cities'. 



Los Angeles 


Chicago 


Phoenix 


Denver . 


Baltimore . ■ 


New Orleans 


Detroit 


. Atlanta 


Seattle . 


Philadelphia ' 





Sort the cities into separate groups in the blank -space below, 
so that ci'ties in- the sajne group have small distances between- them 
and are neax one another. Please sort eacli city into one and only 
one group . Draw a circle around each separate group. Use as few or 
as many groups -as you think are necessary; each group may contain' 
as few 'or as many cities as seem appropriate. 



PLI-ASI; TlJiy^ TO TIE NliXT PAGI- 



30 . ' 



J . 



COPI^LlhT: 'rim OTHER -PARTS OF TIE QUESTIONNAIRE 



( 



THEN TURInI to IKE NEJCT PAGE AND.CONTINUE. 
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DiiyicnoNS 



^ Uo this ))a{',c last . . IJe sure -you Have completed the- other parts 
of the guestionnairo before you begin. • v . . ' , 

/. Use your mental picture or ijiuigc of the U.S. 'to locate the 

following cities- on the map provided below. • ■. % ■ 



1. 


Los Angeles 


■ *6. 


-IChicago. 


2. 


Phoenix 


' 7. 


Denver 


3. 


Baltimore 


8. 


New Orleans 


. 4.' 


Detroit 


9. 


Atlanta 


5. 


Seattle ' 


,-1.0-. 


Philadelphia ■ " 



Use a dot (•.) to indicate the 'location of each 'city on t^ie map° 
below.. Then write the number of (iacli city (1 thru 10 .above) over .its 
.dot (b. Please be sure to place all 10 cities on the map. 




PLEASE' lirnURN 'nn- BOOKLLT. TO-TUI- PROCPOR MH-N you .have pINISliED. 
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